Asynchronous visual event-based time-to-contact
نویسندگان
چکیده
Reliable and fast sensing of the environment is a fundamental requirement for autonomous mobile robotic platforms. Unfortunately, the frame-based acquisition paradigm at the basis of main stream artificial perceptive systems is limited by low temporal dynamics and redundant data flow, leading to high computational costs. Hence, conventional sensing and relative computation are obviously incompatible with the design of high speed sensor-based reactive control for mobile applications, that pose strict limits on energy consumption and computational load. This paper introduces a fast obstacle avoidance method based on the output of an asynchronous event-based time encoded imaging sensor. The proposed method relies on an event-based Time To Contact (TTC) computation based on visual event-based motion flows. The approach is event-based in the sense that every incoming event adds to the computation process thus allowing fast avoidance responses. The method is validated indoor on a mobile robot, comparing the event-based TTC with a laser range finder TTC, showing that event-based sensing offers new perspectives for mobile robotics sensing.
منابع مشابه
Spatiotemporal features for asynchronous event-based data
Bio-inspired asynchronous event-based vision sensors are currently introducing a paradigm shift in visual information processing. These new sensors rely on a stimulus-driven principle of light acquisition similar to biological retinas. They are event-driven and fully asynchronous, thereby reducing redundancy and encoding exact times of input signal changes, leading to a very precise temporal re...
متن کاملAsynchronous Event-Based 3D Reconstruction From Neuromorphic Retinas
This paper presents a novel N-ocular 3D reconstruction algorithm for eventbased vision data from bio-inspired artificial retina sensors. Artificial restinas capture visual information asynchronously and encode it into streams of asynchronous spike-like pulse signals carrying information on e.g. temporal contrast events in the scene. The precise time of the occurence of these visual features are...
متن کاملContinuous-Time Visual-Inertial Trajectory Estimation with Event Cameras
In contrast to traditional cameras, which output images at a fixed rate, event cameras have independent pixels that output asynchronous pixel-level brightness changes with microsecond resolution. In this paper, we leverage a continuoustime framework to perform trajectory estimation by fusing visual data from a moving event camera with inertial data from an IMU. This framework allows direct inte...
متن کاملAsynchronous frameless event-based optical flow
This paper introduces a process to compute optical flow using an asynchronous event-based retina at high speed and low computational load. A new generation of artificial vision sensors has now started to rely on biologically inspired designs for light acquisition. Biological retinas, and their artificial counterparts, are totally asynchronous and data driven and rely on a paradigm of light acqu...
متن کاملNeuromorphic computer vision: overcoming 3D limitations
Asynchronous, event-based artificial retinas1 are introducing a shift in current methods of tackling visual signal processing.2–4 Conventional frame-based image acquisition and processing technologies are not designed to take full advantage of the dynamic characteristics of visual scenes. A collection of snapshots is static and contains much redundant information. That is because every pixel is...
متن کامل